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Abstract. We study pairs of reals that are mutually Martin-L6f ran- 
dom with respect to a common, not necessarily computable probability 
measure. We show that a generalized version of van Lambalgen's Theo- 
rem holds for non-computable probability measures, too. We study, for 
a given real A, the independence spectrum of A, the set of all B so that 
there exists a probability measure fi so that ij.{A, B} — and {A, B) 
is /X X /x-random. We prove that if A is r.e., then no A2 set is in the 
independence spectrum of A. We obtain applications of this fact to PA 
degrees. In particular, we show that if A is r.e. and P is of PA degree 
so that P 2t a, then A@ P >t 0'. 



1. Independence and relative randomness 

The property of independence is central to probability theory. Given a 
probability space with measure /i, we call two measurable sets A and B 
independent if 

The idea behind this definition is that if event B occurs, it does not make 
event A any more or less likely. This paper considers a similar notion, that 
of relative randomness. The theory of algorithmic randomness provides a 
means of defining which elements of Cantor space (2"^) are random. We call 
A € 2" Martin-Lof random if A is not an element of any effective null set. 
We denote the class of all Martin-Lof random reals by mlrQ 

We say that A is Martin-Lof random relative to B, ov A £ MLR(i?) if 
A is not an element of any null set effective in B. Relative randomness 
is analogous to independence because if ^ G MLR(i?), then not only is 
A a random real but even given the information in B, we cannot capture 
A in an effective null set. If we start with the assumption that A and B 
are both Martin-Lof random, then the following theorem of van Lambalgen 
establishes that relative randomness is symmetrical. 

Theorem 1.1 (|Van Lambakenl [l987l ]l. IfA,Be MLR then A e MLR(B) 



if and only if B € MLR(^) if and only if A® B £ MLR. 

We can extend the notion of relative randomness to any probability mea- 
sure. We take 7(2^) to be the set of all Borel probability measures on 
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Cantor space. Endowed with the weak-* topology, y(2'^) becomes a com- 
pact metrizable space. The measures that are a finite, rational-valued, linear 
combination of Dirac measures form a countable dense subset, and one can 
choose a metric on y(2'^) that is compatible with the weak-* topology so 
that the distance between the those basic measures is a computable func- 
tion, and with respect to which 7(2^) is complete. In other words, 'J'{2'^) 
can be given the structure of an effective Polish space. We can represent 
measures via Cauchy sequences of basic measures. This allows for coding 
measures as reals, and one can show that there exists a continuous mapping 
p : 2^ ^ y(2^) so that for any X G 2"^, 

p~^{{p{X)}) is a n?(X) class. 

For details of this argument, see lOav and Miller! jtal |. If /i S J'(2'^), any real 
R with p{R) = p is called a representation of p. 

We want to define randomness relative to a parameter with respect to a 
probability measure p. Martin-Lof's framework easily generalizes to tests 
that have access to an oracle. However, our test should have access to two 
sources: the parameter of relative randomness and the measure (in form of 
a representation). 

Definition 1.2. Let R^ be a representation of a measure /i, and let A € 2'^. 

(a) A (i?^, A)-test is given by a sequence (Vn : n G N) of uniformly © 
^)-classes Vn C 2'^ such that for ah n, p{Vn) < 2"". 

(b) A real X € 2"^ passes an {R^,A)-test (V„) if X fln"^"- 

(c) A real X 2^ is (R^, A)- random if it passes all (i?^, 74)-tests. 

If, in the previous definition, A = 0, we simply speak of an Rf^-test and 
of X being R^^-random. 

The previous definition defines randomness with respect to a specific rep- 
resentation. If X is random for one representation, it is not necessarily 
random for other representations. On the other hand, we can ask whether 
a real exhibits randomness with respect to some representation, so the fol- 
lowing definition makes sense. 

Definition 1.3. A real X G 2^ is p-random relative to A € 2^, or simply 
fi-A-random if there exists a representation R^ of p so that X is {Rfj_,A)- 
random. We denote by MLR^(^) the set of all //-^-random reals. 

For Lebesgue measure A, we sometimes suppress the measure. Hence, in 
accordance with established notation, MLR(^) denotes the set of all Martin- 
Lof random reals. 

A most useful property of the theory of Martin-Lof randomness is the 
existence of universal tests. Universal tests subsume all other tests. Fur- 
thermore, they can be defined uniformly with respect to any parameter. 
The construction can be extended to tests with respect to a measure p. 
More precisely, there exists a uniformly c.e. sequence (Un : n G N) of sets 
Un C 2<^ such that, if we set for i?, A G 2"^ 

^n'^ = {H : ^0, n) G Un, To ^ R,Ti ^ A}, 

then ilAn'^) is an {R, j4)-test and X G 2'^ is (i?, A)-random if and only if 
X Cln.l^n ' • We call (Un) a universal oracle test. 
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Since for any R G 2'^, p ^(p(R)) is Yli{R), we can eliminate the represen- 
tation of a measure in a test for randomness by defining, for any A 2^, 

The resulting class is still since p~^{{p{R)}) is n5(i?) and hence 

compact. 

Proposition 1.4. For any R,A^2^ with p{R) = p, a real X is p-A- 
random if and only if 

n 

Proof. If X is /i-A-random, then it passes every (i?^, A)-test for some repre- 
sentation i?^ oi p, in particular the instance iUn ) of the universal oracle 
test. Since R^t e p~^({p(i?)}), it follows that X passes 

On the other hand, if for every representation R^ of p, X fails the test 
{U^'^),thenX eCl^U^'"^. □ 

The previous proposition shows that the test Un ' is relate d to the con- 



cept of a un iform test, o rigin allv introduced bv iLevinI |l976l ]. and further 
developed by Gacs 20051 ] and Hovrup and Rojad [2009l | . Hence we call it a 



uniform oracle test. Note that if i?, S are both representations of a measure 
/i, then the uniform oracle tests {Un'^)n and {lAn^)n are identical. 

Definition 1.5. Take G 2^ and p G CP(2^). We say that A and B are 
relatively random with respect to p \i A ^ MLR^(i?) and B G MLR^(^). 

Note that the representations of p witnessing randomness for A and B, 
respectively, do not have to be identical. If A and B are relatively random 
with respect to some measure p, then p might offer some information about 
the relationship between A and B. For example, we know that if A and 
B are relatively random with respect to Lebesegue measure, then any real 
they both compute must be K-trivial. If A and B are both atoms of p 
then clearly A and B are relatively random with respect to p. Given this, 
perhaps the most obvious question to ask about relative randomness is the 
following. 

Question 1.6. For which ^4, i? G 2'^ does there exist a measure p such that 
A and B are relatively random with respect to p and neither A nor B is an 
atom of pi 



This question is closely related to a theorem of iReimann and Slaman 



20081 ]. They proved that an element X of Cantor space is non-recursive if 



and only if there exists a measure p such that X is /i-random and X is not 
an atom of p. 

Van Lambalgen's theorem shows that A and B are relatively random if 
and only \i A® B G MLR. If we take A to be the uniform measure, then 
A® B & MLR if and only if the the pair (A, G 2^^ x 2'^ is Martin-Lof 
random with respect to the product measure A x A i.e. {A,B) G MLR^^xA- 
We begin our investigation into relative randomness by showing that van 
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Lambalgen's theorem holds for any Borel probabihty measure on Cantor 
space. 

Theorem 1.7. Let ^ € ^(2'^) and let A,B then {A,B) G MLR^x^ if 
and only if A £ MLR^ and B € MLR^(A). 

Proof. Let R be any representation of /i. First let us consider if i? 
MLR^(^). In this case we have that B € {^^Un' . We define an {R, 0)-test 
for 2'^ X 2"^ by = {[r] x [a] : 3r? ^ i? {{(^,V,r) £ This ensures that 

-B) G P|„ V^. By applying Fubini's theorem we can establish that: 

ifi X fi){V^) = / Xv^iX, Y)dfi X d/x 
< I 2~''dn{X) = 2-" 

J2'^ 

Hence (A, is not {R, 0)-random. As this is true for any representation R 
of /i we have that {A, B) ^ MLR^x/^- The same argument shows a fortiori 
that if A MLR^ then {A, B) ^ MLR^x^- 

To establish the other direction assume that -B) ^ MLR^x/^- Again 
let R be any representation of ^. 

Hence [A, B) G fin where (V^) is a universal -R-test for 2'^ x 2*^. Let 

We have that W„ ' is a ^^(i?©^) class and this is uniform in n. However, 
given any X, we do not know whether or not )u(VVn ' ) < fi^^) for some 
decreasing recursive function / such that lim„ /(n) = 0. Hence we cannot 
necessarily turn this into a Martin-Lof test relative to X. In fact it is not 
even necessarily true that liminf„ ^(Wn' ) = 0. We will show that the 
failure to turn this into a Martin-Lof test for some X G 2'^ implies that 
X ^ MLRp,. This is a slight strengthening of the result that van Lambalgen 

obtained in his thesis. Van Lambalgen showed that if liminf^ /^(Wn ' ) 7^ 
then X ^ MLR^. 

However, w e can generalize the proof of van Lambalgen's theorem given 
in iNied [200i|. We define another i?-test by letting 7;^ = {X G 2"^ : 
/x(>V^^) > 2-"}. To see that T^^ < 2"", note that 

in X n)Vi, > / Xv« Y)dn X di2 

= / / Xyv^.x{Y)df,iY)df^iX) 

> / 2""dA.(x) = 2-xr„«) 

Now as 2-2" > X /i)V^,, we have that ^l{T^) < 2~''\ Hence HnTj^ is an 
i?-test. Assume that A ^ MLR^(i2). Then A avoids all but finitely many of 
the sets 7^f^. Hence for all but finitely many n we have that A'W2n'^ — ^""^ 
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and so by modifying finitely many W^"^ we can obtain an {R, ^)-test that 
covers B. Therefore B is not i?-random relative to A. 

For all representations R of fi, we have shown that either A is not R- 
random or B is not i?-random relative to A. However, to prove the theorem, 
it is essential that we get the same outcome for all representations i.e. if 
{A, B) ^ MLR^ then either for all representations R oi fi, A is not R- 
random or for all representations R oi fi, B is not i?-random relative to 
A. 

We can resolve this problem by taking our test (V^) on the product space 
to be a uniform test. In this case we always obtain the same "projection 

Ft X 

tests" (Wn ' ) (independent of R) and hence the same outcome for any 
representation of fi. □ 

Corollary 1.8. If A,B G 2'^ and n € 7(2"^), then A and B are relatively 
random with respect to /i if and only if {A,B) G MLR^x^- 

Corollary 1.9. If A >t B and {A,B) € MLR^x^ then B must be an atom 

of 1^1. 

Proof. This holds because B € MLR^(j4) if and only if B is an atom of fi. □ 

We note that we cannot extend one direction of van Lambalgen's theorem 
to product measures of the form /i x z^. In particular it is not true that if 
{A,B) £ MLR^xi. then A G MLR^ and B £ MLR,^(^). For example we can 
code B into /i and obtain A G MLR^, B G MLR,,(^), {A,B) MLR^xi.- 

Given any X G 2"^, we will use 'R-{X) to denote the set of reals Y such 
that X and Y are relatively random with respect to some measure ^ and 
neither X nor Y are atoms of /i i.e. 

n{A) = G 2^ : (3/i G •J>{2'^))[{A, B) G MLR^x^ and fi{A,B} = 0]}. 

We call 'R-{A) the independence spectrum of A. 

The following proposition lists some basic properties of the independence 
spectrum. 

Proposition 1.10. For all A,B £2^ the following hold: 

(1) A£ n{B) if and only if B £ n{A). 

(2) B £ n{A) implies that A\t B. 

(3) If A is non-recursive and v is a computable, non-atomic measure 
(i.e. a measure with a computable representation and i'{X} = for 
all X £ 2^ ), then TZ{A) has u -measure 1. 

(4) If A£ MLR then MLR(yl) C n{A). 

Proof. ([ID is by definition and ^ is by Corollarv ll.9[ 

([3|) Suppose A is non-recursive and i/ is a computable measure with 
i'{A} = 0. There is a measure /i such that A is not an atom of // and 
A £ MLR^, say via a representation i?^. Let k = + y)/2. There ex- 
ists a representation R^ <t Rfi, as v is computable. We claim that A is 
R^-iayidom.. For if not, then A fails some i?«;-test (W^"). We have 
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Since ii^ <T -R/x, {V^n+i) would define an i?^-test that covers A, contradict- 
ing the assumption that A is -R^-random. Furthermore, by assumption on 
/i and u, K.{A} = 0. Hence 

(MLR,(A) \ {B : k{B} / 0}) C n{A), 

by van Lambalgen's Theorem. 

Now i/(MLRk(^)) = 1 because the complement of MLR^(74) is a k null 
set and hence a v null set {v is absolutely continuous with respect to k 
by definition). Moreover, the set of atoms of k is countable and so has 
i/-measure by the assumption that u is non-atomic. This gives us that 

i/(MLR,(yl) \ {B : n{B} / 0}) = 1 

and thus uTZ{A) = 1. 

([1]) Suppose A is Martin-Lof random. By the definition of TZ{A) and 
Theorem O we have that MLR(^) C n{A). 

On the other hand, A is not recursive and hence by ([3]), ^^{A) has mea- 
sure 1 for any computable, non-atomic measure. Let z/ be a computable, 
non-atomic measure orthogonal to Lebesgue measure (e.g. the (1/3,2/3)- 
Bernoulli measure). Since vTZ[A) = 1, TZ{A) has to contain a z/-random 
element X. But X cannot be relatively Martin-Lof random. Therefore, 
MLR(^) C n{A). □ 

The proposition shows that, outside the upper and lower cone of a real A, 
the complement of ^^{A) is rather small measure wise. On the other hand, 
the above properties leave open the possibility that TZ{A) is just the set of 
reals that are Turing incomparable with A. We will now establish that this 
is not necessarily the case. 

Proposition 1.11. Let R he a representation of a measure fi. If A £ 2'^ is 

such that 

(1) A is r.eE 

(2) A is R-random, and 

(3) A is not an atom of fj,, 

then R®A>T R! . 

Proof. Given such an R and A, let Ag be a recursive approximation to A. 
We define the function / <t A® R by: 

f{x) = min{s : (3m < s){As \ m = A f m A /is[^ \ m] < 2~^)}. 

In this definition we take ^s[cr] to be an ii-recursive approximation to /i[cr] 
from above. Note that / is well defined because A is not an atom of We 
claim that if g is any partial function recursive in R, then for all but finitely 
many x € dom{g), we have that f{x) > g{x). To establish this claim, let 
g be an i?-recursive partial function. We will build an i?-test {Un}neuj by 
defining CZ„ to be: 

{X G 2- : {3x > n){3m){g{x) | A fi[Ag^,^ \ m] < A X y {Ag^.^ \ m))}. 



We mean here, of course, that A is recursively enumerable viewed as a subset of N, 
by identifying a subset of N with the real given by its characteristic sequence. 
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Because any x € dom{g) adds a single open set \ "t-] for some m) of 

measure less than to those Un with n < x, we have constructed a valid 
test. Now if g{x) 4,> f{x), then by definition of /, there is some m < f{x) 
such that iJ.\A \ m] < and A \ m = ^/(x) \ ni = \ Thus for 

all n < X, ^ G Un- Because A G MLR^(i?) we have that /(a;) > g{x) for all 
but finitely many x in dom((7). 

Let g{x) be the /^-recursive partial function with domain R' such that 
g{x) is the unique s such that x G -R^+i \ -^s- -^^^ almost all x, we have that 
x £ R' ii and only if a; € R'j^^-^ and so i?' <t ^ © -R. 

□ 

Theorem 1.12. Let R be a representation of a measure fi. If 

(1) A is r.e., 

(2) A is (JL-random, and 

(3) A is not an atom of fi, 
then R®A>T 0'. 

Proof. Note the following characteristics of the previous proof. First the 
totality of / does not depend on the fact that A is ii-random, it only depends 
on the fact that A is not an atom of /i. The construction is uniform so there 
is a single index e such that ^e{A(BR) is total if R is any representation of 
Additionally if A is i?-random then for all but finitely many x, ^e{A(BR; x) > 
g{x) where g is any i?-recursive partial computable function. 

Let R be any representation of ^u. The set {A @ R : R\s a, representation 
of //} is a n5(^ © R) class and <I>e is total on this class. From A © i? we can 
compute a function / that dominates ^e{A © R) where A is i2-random. As 
/ dominates any i?-recursive partial function we have that A®R >t 0'- ^ 

Corollary 1.13. If A is r.e. and B <t $' then B n{A). 

The question remains, however, how big the independence of a real can 
be outside its upper and lower cones. 

Question 1.14. Is the set of all X so that X |t ^ and X ^ HiA) countable? 

2. Recursively enumerable sets and PA degrees 

We will now give two (somehow unexpected) applications of Theorem ll.121 
to the interaction between recursively enumerable sets and sets of PA degree. 
Recall that a set ^ C N is of PA degree if it is Turing equivalent to a set 
coding a complete extension of Peano arithmetic (PA). PA degrees have 
many interesting computability theoretic properties. For instance, a set is 
of PA degree if and only if it computes a path through every non-empty 
class. However, a complete degree-theoretic characterization of the PA 
degrees is still not known. If A >t 0', then A is of PA degree. On the other 
hand, Godel's First Incomplet eness Theorem impl i es th at no r.e. set can 
be a complete extension of PA. Jockusch and Soard 1972 ] showed moreover 



that if a set is of incomplete r.e. degree, it cannot be of PA degree. 

It seems therefore worthwile to gain a complete understanding how r.e. 
sets and PA degrees are rela ted. The crucia l fact that links Theorem 11.121 



to PA degrees is a result by iDav and Miller! |tal ] . They showed that every 
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set of PA degree computes a representation of a neutral measure. Such a 
measure has the property that every real is random with respect to it, i.e. 
2*^ = MLR ,;,. The existence of neutral measures was first established by 
LevinI |l976f . 



Our first result shows that below 0', r.e. sets and PA degrees behave quite 
complementary 0. 

Corollary 2.1 (to Theorem I1.12p . If A is an r.e. set and P a set of PA 

degree such that P A then P ® A >t W . 



Proof. By the result of lDav and Milled [tal | mentioned abov e, P computes a 



representation i?^ of a neutral measure /j, and A € MLR^. iDav and Miller 
[taj l also showed that a real X is an atom of a neutral measure if every 
representation of the measure computes X. Now because P A, we have 
that A is not an atom of /i. Thus all hypotheses of Theorem 1 1 . 1 2 1 are satisfied 
and we have P © A >t 0'. □ 

Corollary 12.11 strengthens a result due to Kucera and Slaman (unpub- 
lished). Recall that a function / : N — )■ N is diagonally non-recursive if 
/(n) 7^ ^nin) for all n, where ipn denotes, as usual, the nth partial recursive 
function. Kucera and Slaman constructed a a I0W2 r.e. set so that A(Bf =t 0' 
for any diagonally non-recursive function / <t 0'. It is well-known that ev- 
ery PA degree computes a {0, l}-valued diagonally non-recursive function. 
Hence the set constructed by Kucera and Slaman joins any PA degree below 
0' to 0'. Corollary [2T] yields that this is in fact true for any r.e. set. 

One can now ask which kind of incomplete r.e. sets can be boun ded by 



PA degrees below 0'. This question was first raised bv iKuceral [2004] 



For which incomplete r.e. sets A does there exist set P of PA 
degree such that A <t P <t ^' ? 

We can use Corollary 12.11 to completely answer this question. We say a 



set B is of PA degree relative to a set A, written B ^ A (see [Simpson 



I977I ]). if B computes a path through every n5(A) class. One well-known 



fact we will make use of is the following. If P is of PA degree, then there 
exists a set Q of PA degree such that P ^ Q. One way to prove this fact is 
to observe that the 115 class 

{{A, B) £2'^ x2'^: A£ DNR2 AB € DNR2(^)} 

is non-empty, where DNR2 and DNR2(A) are the classes of {0, l}-valued di- 
agonally non-recursive functions and {0, l}-valued diagonally non-recursive 
functions relative to A, respectively. 

Theorem 2.2. If A is an r.e. set then the following are equivalent: 

(1) A is low. 

(2) There exists P, P ^ A and P is low. 

(3) There exists P of PA degree such that %' >t P >t A. 



^After the authors announced the result presented in Corollarv l2.1l proofs not involving 
measure theoretic arguments have been found independently by A. Kucera and J. Miller. 
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Proof. ([I]) =^> ([2]): There is a (non-empty) Iii{A) class of sets S » ^. 
Relativize the low basis theorem to find P ^ A and P' =t A' . As A is low 
so is P. 

(HD ^ da]): This is clear. 

dSD ^ (H}: Take any Q of PA degree such that P Q. Now Q >t A 
because otherwise Q © j4 > 0' but this is impossible because P >t Q (B A 
and P 0'- Hence P ^ A. But now we have that 0' is r.e. in A and also 
0' computes a DNR function relative to A. Hence by relativizing Arslanov's 
completeness criterion we have that A' =x 0'- □ 

Observe that in the proof of ([3]) =^ (H]), showing P ^ A only used the 
facts that P ^' and P >t A. Hence we get a final corollary. 

Corollary 2.3. If P is a set of PA degree and A is an r.e. set such that 
P>T A and P 0', then P A. 
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